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Abstract 

Aim of this work is not trying to explore a macroscopic behavior 
of some recent model in statistical mechanics but showing how some 
recent techniques developed within the framework of spin glasses do 
work on simpler model, focusing on the method and not on the an- 
alyzed system. To fulfil our will the candidate model turns out to 
be the paradigmatic mean field Ising model. The model is intro- 
duced and investigated with the interpolation techniques. We show 
the existence of the thermodynamic limit, bounds for the free energy 
density, the explicit expression for the free energy with its suitable 
expansion via the order parameter, the self-consistency relation, the 
phase transition, the critical behavior and the self- averaging proper- 
ties. At the end a bridge to a Parisi-like theory is tried and discussed. 

1 Introduction 

In the past twenty years the statistical mechanics of disordered systems 
earned an always increasing weight as a powerful framework by which an- 
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alyze the world of complex networks [1 5 38J[15 41j. 
The "harmonic oscillator" of this field of research is the Sherrington Kirk- 
patrick model [3pJ (SK), on which several schemes have been tested along 
these years [33]; the first method developed has been the replica trick 
[14] which, in a nutshell consists in expanding the logarithm of the par- 
tition function Z(/3) in a power series of such a function via In Z(/3) — 
lim^—jo (Z(/3) n — allowing in some way, its analytic continuation to 

the n — ► limit [39j . Such analytic continuation is not at all simple and 
many efforts have been necessary to translate this problem in the language 
of theoretical physics built by symmetries and their breaking [43] . In this 
scenario a solution has been proposed by Parisi (and recently proved by 
Guerra [55] and Talagrand |46| ) with the well known Replica Symmetry 
Breaking scheme, both solving the SK- model by showing a peculiar "pic- 
ture" of the organization of the underlaying microstructure of this complex 
system as well as conferring a key role to the replica-trick method. 
The replica trick however still pays the price of requiring an "a priori" 
ansatz at some stage of its work and several mathematical problems con- 
cerning its foundations and validity are still open 45j. 
As a consequence, in the recent past ten years, another method, called the 
cavity method [3D], has been largely improved, mainly thanks to its ability 
to work without ansatz and to a natural predisposition for being imple- 
mented into the interpolating technique scheme 28||34 35] [5] [5]. Also if 
not so powerful to solve the whole SK-problcm without working in synergy 
with the replica framework, is, at least for some kind of questions, a valid 
alternative to it [36] [22] [10] . 

Aim of this paper is to show some of the features obtainable within the 
cavity method by applying it to a simple model, the mean field Ising model 
[1] [43j , which can be solved with standard methods without requiring nor 
the replica trick neither the cavity method itself. Consequently attention 
should be payed on the method, which, once applied on a paradigmatic 
model, should be clearer to the non-expert reader than when applied on 
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complex systems as the SK. 

The paper is structured as follows: Hereafter, still in the first section, the 
model is introduced. In section ^ the interpolating technique for obtain- 
ing the thermodynamic limit and the bounds in the size of the system 
are discussed. In section (O the interpolating technique to obtain an ex- 
plicit expression for the free energy and consequently the phase diagram 
are studied. Section (U]) is dedicated to the phase transition: the lacking of 
the infinite volume limit against a vanishing perturbing field, the scaling 
of the order parameter at criticality and the self-averaging relations are 
discussed. The last section ([5]) is a trial introducing technique which aims 
to reproduce the Parisi scheme within this simpler framework. 

1.1 Definition of the model and thermodynamics 

The Hamiltonian of the Ising model is defined on TV spin configurations 
g : i — > o-j = ±1, labeled by i = 1, . . . , N, as pQ [33] 

l<i<j<N 

We assume throughout the paper that there is no external field. The ther- 
modynamic of the model is carried by the free energy density /at(/3) = 
Fn(0)/N, which is related to the Hamiltonian via 

e -/WVC0 = Zn ((3) =J2 e ^ Elsi< ^ ^ , (2) 

a 

Zn{(3) being the partition function. For the sake of convenience we will 
not deal with /jv(/3) but with the thermodynamic pressure a{(3) defined 
via 

a(P)= lim a N (P)= lim -0f N (fi) = lim ^-lnZ N (/3). (3) 

N^oo N^oo N^oo 1\ 

A key role will be played by the magnetization m, its fluctuations and its 
moments, and so let us introduce it as 

1 , ^ Y, a m N e-P HN ^ 

Ki<N t-" 1 
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Let us consider also its rescaled fluctuation by introducing the following 
random variable 

v i 

by which the magnetization can be expressed as (mjv) = (C/v)-^ -1 / 2 ; fur- 
ther, let us define 7(/3) = 1/(1 — (3) and state, without proof [20], that in 
the interval < /3 < f3 c = 1, in the thermodynamic limit the distribution 
of £ (<r) = limjv^oo £/v (c) is a centered Gaussian with variance equal to 
7(/3). The boundary at which the variance of the distribution diverges (i.e. 
= p c = 1) defines the onset of the broken ergodicity phase. 

2 Thermodynamic limit 

2.1 Bounding the free energy in the system size 

The first step when dealing with the statistical mechanics package is, once 
defined the relevant observable, checking that the model is well defined (i.e. 
it admits a good but non trivial thermodynamic limit). As this task maybe 
not simple (as for the SK model or worse for the Hopfield model of neural 
network |21j ) working out its supjy may help as a first pre-step. This is 
usually a simpler task [24]. With a little abuse of language, reminiscent of 
spin-glass theory, we call this procedure annealing. 

Annealing of the free energy 

Annealed is the thermodynamical regime in which the thermal noise has a 
strong effect on the macroscopic behavior of the observable, while details 
of the Hamiltonian play a small, thus not negligible, role. In spin glasses 
another way to think at the annealing is by assuming that the dynamics 
of the spins happens on the same time-scale of the dynamics of the links 
between the spins. For the Ising model there is no true annealing as there 
are no quenched variables and the closest procedure to be performed can 
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be obtained trivially as follows: 

Z N ((3) < ^V^^e^ (6) 

cr 

±lnZ N ({3) < In2+|(l-i)^a(/3)<ln2+^ (7) 

Following this approach the next step is trying and bound, in the volume 
size, the free energy from above and from below. For the Ising model this 
can be obtained as follows: 

Upper bound of the free energy 

While for disordered systems bounding the free energy in the volume limit 
is not an easy task, for model with no disorder such bounds can be easily 
obtained [18] [33] . Consider the trivial estimate of the magnetization m, 
valid for all trial fixed magnetization M 

m 2 > 2mM - M 2 (8) 

and plug it into the partition function to get (neglecting terms vanishing 
in the thermodynamic limit) 

Now this sum is easy to compute, since the magnetization appears linearly 
and therefore the sum factorizes in each spin. Physically speaking, we 
replaced the two-body interaction, which is difficult to deal with, with a 
one-body interaction. Then we try to compensate this by modulating the 
field acting on each spin by means of a trial fixed magnetization and a 
correction term quadratic in this trial magnetization M . 

Remark 1 This idea is reminiscent of a recent powerful method J2)]j7]] \26]/ 

introduced by Aizenman and coworkers for the spin-glass theory, in which 
the key idea, is letting interact the system one is dealing with, with an 
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external structure in such a way by which, sending the size of the this 
structure to infinity, thanks to the mean field nature of the interaction, 
the system no longer interacts with itself, making the mathematical control 
simpler. 

The result is the following bound 

— In Z N {(3) > sup{ln2 + lncosh(/3M) - \(3M 2 } (9) 

that holds for any size of the system N. The result is quite typical, the 
term In 2 is there because the sum over a spin of a Boltzmann factor linear 
in the spins is twice the hyperbolic cosine, which appears as second term 
(that essentially gives the entropy). The third term is the internal energy 
(multiplied by —j3). 

Lower bound of the free energy 

In order to get the opposite bound to Q, let us notice that the mag- 
netization m can take only 27V + 1 distinct values. We can therefore split 
the partition function into sums over configurations with constant magne- 
tization in the following way 

Z M = £E"W l/3JVm2 (io) 

<T M 

using the trivial identity 

5^<W = i- (ii) 

M 

Now inside the sum m = M, which means also 

to 2 = 2mM - M 2 . (12) 
Plugging the latter equality into Zn((3) and using the trivial inequality 

0~mM < 1 
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yields 

Z N {0) < E E e? NmM e-^ NM2 . (13) 

M a 

Now one can carry out the sum over a bounding the remaining sum over 
M by 2N + 1 times its largest term gives then 

Zn(P) < V sup{ln2 + lncosh(/?M) - \flM 2 } (14) 
— 4 m 2 

M nl 

from which 

■4 lnZ N {[3) < In 2 J" 1 + sup{ln2 + lncosh(/3M) - \fiM 2 } . (15) 
iv iv m 2 

This gives, together with ©, the exact value of free energy per site at least 
in the thermodynamic limit. 

2.2 Bound by interpolating the size of the system 

A breakthrough in showing the existence of the thermodynamic limit for 
mean field disordered systems has been obtained recently within the Guerra- 
Toninelli interpolation scheme [33]. Previously several beautiful model- 
specific attempts were made P~3] [H] [H] , but this interpolating scheme 
showed an immediate wide range of applications and its beauty is its sim- 
plicity. We are going to introduce it applied to the Ising-model. 
Divide the N spin system into two subsystems of N\ and N 2 spins each, 
with N\ + N2 — N. Denoting by mi(a), 7712(17) the magnetization corre- 
sponding to the subsystems, i.e. 

1 Nl 1 N 

m i( CT ) = attE' 7 * > m2 ^ = jj: E 

1 »=1 1 i=N! + l 

one sees that m(tr) is a convex linear combination of mi(cr) and m^cr): 

, . Ni . . N 2 , , , , 

Since the function x — > x 2 is convex, one has 

Zn(J3) < Eexp^^m^d) + N 2 m 2 2 (a))) = Z Nl (P)Z Na (fl) 
M 
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and 

Nf N (0) = ~ h-iZ N (/3) > NxftfM + N 2 f N M- (17) 



Theorem 1 The infinite volume limit for a n {(3) does exist and equals its 
sup. 

lim ajv(/3) = supaAr(/3) = a{(3) (18) 

N^oo jy 

Proof 

In a nutshell the two key ingredients are the subadditivity (iV/jv > Nxfi + 
-W2/2) and the property of the free energy density of being limited from 
above uniformly in N which is established elementary by using the anneal- 
ing. It is also evident by considering Eq.s (|9ll5p □. 

Unfortunately, the very simple approach we illustrated above as it is, does 
not apply to the SK model, where the randomness of the couplings prevents 
us from exploiting subadditivity directly on the Hamiltonian Hm- However, 
the related strategy, which allows in some sense an extension to mean field 
spin glass models is to interpolate between the original systems of N spins, 
and two non-interacting systems, containing N% and N 2 spins, respectively, 
and to compare the corresponding free energies. To this purpose, consider 
the interpolating parameter < t < 1, and the auxiliary partition function 

Z N (t) = e MP (Ntm 2 (a) +Ni(l- t)m\{a) + JV a (l - t)m 2 2 (a))). 
{<?} 



(19) 



Of course, for the boundary values t — 0, 1 one has 



~hiZ N (l)=f N tf) (20) 

- J L] Il Z N (0) = ^f Nl (/3) + ^-fNM (21) 
and, taking the derivative with respect to t, 

d 1 , „ ,.s I 2/ N ^1 2,, N 2 2 



In Z N (t) =-{ m z (o-) 7 mi{o-) -mi(a) ) > 0, (22) 

dtN/3 W \ 17 N N 2V ' 1 ~ ' V ' 
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where ( )t denotes the Boltzmann-Gibbs thermal average with the extended 
weight encoded in the t-dependent partition function ((T9|) . Therefore, inte- 
grating in t between and 1, and recalling the boundary conditions (|2T)I 20), 
one finds again the superadditivity property (fT7|) . 

The interpolation method, which may look unnecessarily complicated 
for the Curie- Weiss model, is actually the only one working in the case of 
mean field spin glass systems. 



3 The structure of the free energy 

In this chapter we adapt the work [B] developed for the SK model to the 
mean field Ising model. 

The main idea of the cavity field method is to look for an explicit expres- 
sion of ajv(/3) = — /3/at(/3) upon increasing the size of the system from N 
particles (the cavity) to N+ 1 so that, in the limit of N that goes to infinity 

hm (^m^-pm = _ p m (23 ) 

because the existence of the thermodynamic limit (sec. 12. 'l\ implies only 
vanishing correction of the free energy density. 

3.1 Interpolating cavity field 

As we will see, the interpolating technique can be very naturally imple- 
mented in the cavity method; let us consider the partition function of a 
system made by N + 1 spins: 

(24) 
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With the gauge transformation Cj — ■+ <7j<7iv+i, which, of course, is a sym- 
metry of the Hamiltonian, we get 

Z N+1 (f3) = 2Z N (/3*)u>(e^ S ><,<» °i) (25) 

where Hi is the Boltzmann state at the inverse temperature (3* = (3 
(note that in the thermodynamic limit the shifted temperature converges 
to the real one (3* — * f3). Let us reverse the temperature shift and apply 
the logarithm to both the sides of Eq. I]25p to obtain 

\nZ N+l ([3^p-) =\n2 + \nZ N (0)+\nuj N (e£^<><«' 7 *) (26) 



Equation (|26|) tell us that via the third term of its r.h.s. we can bridge 
an Ising system with N particles at an inverse temperature (3 to an Ising 
system with N + 1 particles at a shifted inverse temperature (3* = (3{N + 
l)/iV. Focusing on such a term let us make the following definitions. 

Definition 1 We define an extended partition function Z]^(f3,t) as 

Z N ((3, t) = e-W"'e* Si<i<w '* (27) 

Note that the above partition function, at t = (3, turns out to be, via 
the global gauge symmetry <jj — > <7j<7j\r+i, a partition function for a system 
of N + 1 spins at a shifted temperature (3* apart a constant term. On the 
same line 

Definition 2 we define the generalized Boltzmann state ( )t as 

(*V)>t = [ - J r± T — A (28) 

F(a) being a generic function of the spins. 

Definition 3 Related to the Boltzmann state ( ) we define the cavity func- 
tion ^(f3, t) = limjv-Kxj ^iv(/3) t) as 

*jv(/9,*) = ln(e^£i<*<« CTl ) (29) 
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Proposition 1 The cavity function &((3,t) is the generating function of 
the centered momenta of the magnetization, examples of which are 

0*jv(/M) 



dt 



(m N ) t (30) 



d 2 y N (l3,t) 2 2 

^2 = ( m N)t - (m N ) t (31) 

Proof 

The proof is straightforward and can be obtained by simple derivation: 



= (m N ) t 



dt 



Z^cr AT Z^l<i<AT a « e e 



y e -0H N {<j) e j T Y. i ai 

The second derivative is worked out exactly as the first □. 

Remark 2 VFe stress iftai m the disordered counterpart (i.e. the SK model) 
a proper interpolating cavity function is defined by introducing \ft instead 
oft. This reflects the property of the Gaussian coupling of adding another 
extra derivation due to Wick theorem. It is worth nothing that again the 
Gaussian coupling makes necessary the normalization factor V~N instead 
of N in front of the Hamiltonian such that the adaptation from Ising t/N 
to SK y/t/N is the same for t and N . 

Definition 4 We define respectively as fillable and filled monomials the 
odd and even momenta of the magnetization weighted by the extended Boltz- 
mann measure such that 

• (m^ t+1 ) i with n e N is fillable 

• (m 2 j^}t with n eN is filled 

3.2 Saturability and gauge-invariance 

The next step is to motivate why we introduced the whole machinery: The 
first reason we are going to show are peculiar properties of both the filled 
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and the tillable monomials. In the thermodynamic limit, the first class 
do not depend on the perturbation induced by the cavity field and, at 
t = (3, the latter (via the o~i — > CjtT/v'+i symmetry) is projected into the 
first class. The second reason is that the free energy can be expanded via 
these monomials, so a good control of them means a good knowledge of the 
thermodynamic of the system. 

Theorem 2 In the N — > oo limit the averages (m 2 ^ 1 ) of the filled mono- 
mials are t-independent for almost all values of f3, such that 

lim dt(mj^) t = 

N— *oo 

Proof 

Without loss of generality we will prove the theorem in the simplest case 
(for (m 2 N )); it will appear immediately clear how to generalize the proof to 
higher order monomials. Let us write the cavity function as 

y N {P,t)=]xiZ N (p,t)-\nZ N (l3) (32) 

and derive it with respect to [3: 

go = y(( m w) - ( m N)t)- (33) 

We can introduce an auxiliary function Ypf([3,t) = {(rn 2 N ) — (m 2 N ) t ) such 
that: 

r N (p,t) = ^d p y N ((3,t) (34) 
and integrate it in a generic interval [(3\ , fo] ■ 

T N (l3,t)d(3 2 = i[* JV (/M)-'I' J v(/M)]. (35) 

Now we must control ^n(P, t) in the N — > oo limit; the simplest way is 
to look at its t-streaming dt^N{P,t) — (mj\r)t such the iV-dependence is 
just taken into account by the Boltzmann factor inside the averages and, 
as (mjv)t S [—1,1], in the thermodynamic limit ^S(f3, i) remains bounded 
and the second member of (|35|) goes to zero such that, V [f3\,f3^[, Tjv (/?,£) 
converges to zero implying {m 2 N ) t — > {m 2 N )U. 
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Remark 3 A consequence of this property, in the spin glass theory, turns 
out to be the stochastic stability \4S^J 16} / . 

The next theorem is crucial for this section, so, for the sake of simplicity, 
we split it in two part: at first we prove the following lemma than it 
will make us able to proof the core of the theorem itself which will be 
showed immediately after. For a clearer statement of the lemma we take 
the freedom of pasting the volume dependence of the averages as a subscript 
close to the perturbing tuning parameter t. 

Lemma 1 Let ( )jv and ( )jv,t be the states defined, on a system of N 
spins, respectively by the canonical partition function Zn(/3) and by the 
extended one Zj\r(f3,t); if we consider the ensemble of indexes {ii,..,i r } 
with r £ [1, N], then for t = f3, where the two measures become comparable, 
thanks to the global gauge symmetry (i.e. the substitution — » o-iCTN+i) 
the following relation holds 

WAT,t=/3(oti— o"i r ) = Lj N+ i(a il ...a ir a r N+1 ) + 0(-^) (36) 

where r is an exponent, not a replica index, so if r is even o~ 7 N+1 = 1, while 
if it is odd cr r N+1 — cr/v+i- 

Proof 

Let us write cj/v,t for t — 0, defining for the sake of simplicity ir = ...<7j r : 
u N , t =(3(o-) = ly^-l—eVW^^^J'^ + VW^^'TT}. (37) 

Introducing first a sum over o~n+i a t the numerator and at the denominator, 
(which is the same as multiply and divide for 2 N because there is still no 
dependence to erjv+i) and making the transformation cr, — > crj(Tjv_)_i, the 
variable o~n+i appears at the numerator and it is possible to build the 
status at N + 1 particles with the little temperature shift which vanishes 
in the thermodynamic limit: 

UN,t=p{o-) = Lu N+ i{aa r N+1 ) + 0(i)D. (38) 
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Using this lemma we are able to proof the following 



Theorem 3 Let (M) be a fillable monomial of the magnetization, (this 
means that (mM) is filled). We have: 

lim \im(M) t = (mM) (39) 

AT— ^00 t—*@ 

Proof 

The proof is a straightforward application of Lemma [Tp. 



3.3 The free energy via the interpolating cavity method 

The fact that the free energy is expressed as the difference between an 
entropy term coming from a one-body interaction and the internal energy 
times (3 is typical of thermodynamics. We found this feature when looking 
at the bounds (|9")), p5[) ; now, stating the next fundamental theorem, we find 
the same structure via this interpolating version of the cavity field method. 

Theorem 4 The following relation holds in the thermodynamic limit: 

a (f3)=\n2 + ^(t^f3)-(3^- (40) 

Proof 

Let us consider again the partition function of a system made up by (iV+1) 
spins and point out with (3 the true temperature and with (3* = (3(1 + N^ 1 ) 
the shifted one: 

Z N+1 ((3)= V e 7WTT El ^-<^ JV + 1<Tl ^ =2^e75 5;is,< ^ Nffi ° J e7fc £ i<-<» 

(41) 

Now we multiply and divide by Z^([3*) the right hand side of eq. (|4"T1) . 
then we take the logarithm on both sides and subtract from every member 
the quantity In Zn+i (/?*); expanding In Zn + i(/3) around (3 = (3* as 

\nZ N+1 (l3)-\nZ N+1 (P*) = (/3-/3*)d , lnZ N+1 (f]*) + 0((/3-/3*) 2 ) (42) 
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with 



/ N + 1 0* 
P-P* = -8*(V - 1) = |v + ° (iV } (43) 



we substitute with /3* inside the state u> and neglecting corrections 
OiN- 1 ) we have: 

lnZ N+1 {0*) + (0-0*)d * \nZ N+1 {0*) = 

In 2 + In Z N (0*) + In Lj N ^.{e^TT ^k.<» j ' <t ') + O^ 1 ), (44) 

where, with the symbol u)n,0* we stressed that the temperature inside 
the Bolzmann average is the shifted one. Using the variable a{0*) and 
renaming 0* — > in the thermodynamic limit we get: 

a(/?)+/?^^= In 2 + *(* = /?). (45) 

and this is the thesis of the theorem □. 



3.4 Self-consistency of the order parameter via its stream- 
ing 

As we saw in the last section the cavity function is deeply related to the 
free energy. Usually the internal energy is much simpler to evaluate than 
the free energy because there is no contribution by the entropy, which, 
especially in complex system, can make things much harder; consequently 
if we learn how to extrapolate information from the cavity function we 
can obtain information for the free energy. To fulfil this task we state the 
following theorem. 

Theorem 5 When taken a generic well defined function of the spins F(a), 
the following streaming equation holds: 

d{FN g ^ )}t = (F N (a)m N ) t - (F N (a)) t (m N ) t (46) 
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Proof 

The proof is straightforward and can be obtained by simple derivation: 

d(F N (a)) t _ J2 a F N (a)e-^ H «^e^^<«^ 
— Ot 



£ CT -Fiv(cr)e' /3ifjv( ' T) e^ £k*<« ' 
^ CT e-/3«iv(<T) 

= (F N (a)m N ) t - (F N (a)} t (m N ) t .a 

We now want to expand via filled monomials of the magnetization the cavity 
function by applying the streaming equation (|46p directly to its derivative, 
thanks to Eq. ((30)) . It is immediate to find that the streaming of (mjv)t 
obeys the following differential equation 

d t (m N ) t = (m 2 N ) t - (m N ) 2 t (47) 

which, thanks to Theorem Q, becomes trivial in the thermodynamic 
limit. In fact, calling to = limjv^oo m ./v and skipping the subscript t on 
limjv^oo( m Ar)t = (to 2 ) we obtain 



1 „ , i , (to 



9 *<™>* = 1 -(7-^) 



(to 2 ) (to 2 ^ 



which is easily solved by splitting the variables and the solution is 



(m) t = ^m^j tanh( v /(^ 2 )<). (48) 

Once evaluated Eq. (|4"8"]l by using the gauge at t = (3 (i.e. (m) t= p = (to 2 )) 
we get 



V^m 2 ) = tanh(/V(™ 2 )) (49) 
which is the well known self-consistency equation for the Ising-modcl. 
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3.5 The free energy expansion 

From Eq. (|4"5)) it is possible to obtain an explicit expression for the cavity 
function to plug into Eq. (|40[) solving for the free energy. In fact we have 



lim V N (f3,t)= lim / dt'(m N )t> = / dt' {m 2 ) tanh( (m 2 )t) (50) 

N~*oo N~*ooJ J 

from which is immediate to solve for the t): 



*(/3,t) = In cosh (V<m 2 )t). (51) 

The last term still missing to fulfil the expression of the free energy via 
cq. (|40[) , which is immediate to obtain, is the internal energy. 



Proposition 2 The internal energy of the Ising model is 

d -^ = l«) (52) 

Proof 

The proof is straightforward and can be obtained by simple derivation on 
the same line of the previous proofs □. 



Pasting all together we have 

Proposition 3 The free energy of the Ising model is 

a(J3) = In 2 + lncosh(/V(™ 2 )) - ~ ( V(™ 2 >) 2 (53) 

Proof 

The proof proceeds by making explicit Eq. (|4"0|) . □ 



4 The phase transition 

4.1 Breaking commutativity of volume and vanishing 
perturbation limit 

The reasoning of this section can be found, always in the context of spin 
glasses in [9]. 
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Let us move one step backward and consider Eq. at finite N. The 

receipt to obtain the expression of the free energy via the filled monomial is 
to perform at first the N — > oo limit to saturate the tillable term and then 
the t — > /3 limit to free the measure from the perturbation (making it works 
as a cavity field). So in other words a{[3) = lim t ^^ limjv^oo aj\[(f3,t). But 
what if we exchange the limits such that a* {(3) = lim^^co limt—^ aAr(/3, t)l 
Simply, thanks to the gauge invariance limjv-*oo linit— ^(wat) = implying 
<3/(/3,i) = 0, defining the high temperature expression for a* {(3). 
Alternatively one can solve Eq. (|47|) for the variable (£jv(c))t by sending 
first N — > oo and check that these fluctuations scale accordingly the para- 
graph after Eq. (J5]). 

Coherently there is a range in temperature (the paramagnetic phase) in 
which a{[3) — ot*{0) such that the two limits lim t ^ limTv^oo do commute. 
This can be understood as follows: If we consider just the "high tem- 
perature region" saturability implies (to 2 ) = (because \\m^^ 00 {m) t — ► 
(to 2 ) € [0,1] such that {m 2 N ) =0,1 but (to 2 (/3 = 0)) = 0) and the high 
temperature expression holds. In the range f3 £ [0,1] the global symmetry 
of the Hamiltonian — ► OiON+i is a symmetry of the Boltzmann state 
too, while in the range j3 <E ]l,oo] the Boltzmann state shares no longer 
this invariance and ergodicity is lost. In the next section the finding of such 
a critical point, which defines the onset of ergodicity breaking, is discussed 
together with the control of the system at criticality. 

4.2 Critical behavior: scaling laws 

Critical exponents are needed to characterize singularities of the theory at 
the critical point and, for us, this information is encoded in the behavior 
of the order parameter (to 2 ). 

Assuming for the moment that j3 c — 1 (where /3 C stands for the critical 
point in temperature), close to criticality, we take the freedom of writing 
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G(f3) ~ Go • (/3 — l) 7 , where the symbol ~ has the meaning that the term 
at the second member is the dominant but there are corrections of order 
higher than r 7 . 

The standard way to look at the scaling of the order parameter is by ex- 
panding the hyperbolic tangent around \J (m 2 ) ~ obtaining 

= tanh(/? v / (^ 2 7) ~ PV^) - (/?v/( 3 m2)) (54) 

by which one gets 

yR)(l-/3) + i(/3(yR)) 3 )~0. (55) 



The first solution of eq. (|55p is J (m 2 ) = (which is also the only solution 
in the ergodic phase) while the other two solutions can be obtained by 
solving 

(v/R)) 2 - - 3(1 " \) (58) 

close to the critical point, obtaining 

JW)~{f5-l) 1 * (57) 
which gives as the critical exponent 7 = 1/2. 

Within our framework the procedure is by using directly the streaming 
equation (|46p . expanding iteratively in filled monomials, obtaining 

(m) t = (m 2 )t~ f (m) 2 (58) 



JO 

t t f t' 

= (m 2 )t - dt 1 ((m 2 ) 2 i' 2 - 2(m 2 )t' J dt" (to) 2 , + ( J dt"(m) 2 ,)) 

= (m 2 )t- (to 2 ) 2 - + <3((to 2 ) 4 ), 
3 

where higher order terms, close to criticality, can be neglected. Now by 
applying saturability (Theorem [3|) at t = (3 we get 

(m 2 )(/?-l) = (m 2 ) 2 ^ + 0((m 2 ) 4 ) (59) 
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from which wc can derive both the critical point and the scaling expo- 
nent: To find the critical point it is enough to rewrite eci. (|59p switching to 
the rescaled order parameter £(er), such that, by applying a central limit 
argument, its fluctuations become 

^2\ a3 



which diverge as soon as the denominator approaches zero (i.e. for (3 
I")- 

Finding the critical exponent happens on the same line by rewriting eq. ([5; 

as 

and considering, close to criticality, /3 3 ~ 1, which immediately yields 

V(m 2 } ~ ifi- 1)5 (60) 

according to eq. ([57|) . 

Remark 4 Using eq. H58\) to work out an expansion of the cavity function 
we obtain 

*(t) = J dt(m) t = J dt[{m 2 )t - (m 2 ) 2 y + 0((m 2 ) 4 )) (61) 
which gives 

*(*) = <™ 2 >y - <^ 2 ) 2 ^ + 0«rn 2 ) 4 ) (62) 

in perfect agreement with the expansion of the logarithm of the hyperbolic 
cosine. 

Note The same method, respectively applied on the SK and on the Viana- 
Bray model [UJ of diluted spin glass, has been discussed in [2] and [TU] , 
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Remark 5 Using the expansion \62^i for the free energy expression in The- 
orem |-^0| ) we obtain 

a(P) = ln2 + - 1)(to 2 ) - ^(m 2 ) 2 + ... (63) 

by which we argue the critical point must be f3 c = 1. This can be seen as 
follows: Let us note that A(f3) — (/3/2)(/3— 1) is the coefficient of the second 
order of the expansion in power of the order parameter (i.e. y/ (to 2 ) . In the 
ergodic phase (with preserved symmetry) the minimum of the free energy 
corresponds to a zero order parameter (i.e. \J (m 2 ) = 0). This implies 
that A((3) > 0. Anyway, immediately below the critical point values of the 
order parameter different from zero are possible if and only if A((3) < and 
consequently at the critical point A{j3) must be zero. 
This identifies the critical point f3 c = 1. 

Coherently, for the same reason the first order term in the expansion must 
be identically zero. 

Note An identical approach holds also for the SK spin glass model [BJ. 
4.3 Self-averaging properties 

As a sideline, to try and make the work as close as possible to a guide for 
more complex models, it is possible to derive the "locking" of the order 
parameter, which, in other context (i.e. spin glasses) is found as a set of 
equations called Ghirlanda-Guerra [55] and Aizenman-Contucci [3J, while 
in simpler systems as the one we are analyzing, not surprisingly [16j . do 
coincide with just one kind of self-averaging. 

The idea we follow [6J [7] [8] is deriving filled monomial with respect to the 
interpolating parameter, remembering that, in the thermodynamic limit, 
they do not depend on such a parameter end evaluating the " tillable" result 
(which do depends on t) at t = (3 to free the measure from the perturbing 
cavity field. 
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Proposition 4 The self- averaging properties, consequence of the invari- 
ance of filled monomials with respect the perturbing field, hold in the ther- 
modynamic limit; an example being 



Even though we followed the derivation presented in [5] (and deepen in [5] 
for its dilute variant) to obtain such constraints, for the Ising model it is 
straightforward to check that the original idea presented in [22] concerning 
the self-averaging of the internal energy shares the same relation. In fact, 
defining (E) = limjv— >oo En and En = Hn(ct)/N , by direct evaluation we 
have 

Remark 6 The self- averaging property of the order parameter is a conse- 
quence of self- averaging of the internal energy 



Note In this system without disorder the AC relations and the GG iden- 
tities do coincide because of the absence of the external average over the 
noise, which introduce different kinds of self-averaging as discussed for in- 
stance in |19j . 

A less known alternative, richer of surprises, emerges again when investi- 
gating the cavity function. Of course in simple system such investigation 
will not tell us much more than what showed so far, but, remembering we 
want to show a working method more than the results themselves it offers 
for this particular system, we want to explore this last variant. 
Remembering Theorem [3] and Proposition [3] let us rewrite the free energy 
according to 



= lim d t (m N ) = (m 3 ) t - (m 2 )(m) t = (m 4 ) - (m 2 ) 2 



(64) 



lim ((E N ) 2 - {E 2 N )) = =► «m 2 ) 2 - (m 4 » = 



a 



(P) = In 2 + lncosh(t v / (m) t t) 



2 vT^y 



(65) 



and emphasize that the total derivative with respect to (3 is 



da(l3) _ da((3) da{(3) dy/jm 1 ) 



(66) 
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while, from the general law of thermodynamics [33], we know the total 
derivative of the free energy with respect to is the internal energy 

With this preamble let us move evaluating the partial derivative of the free 
energy still with respect (3: 

which thanks to self-consistency for the order parameter (Eq. (|%9f ) be- 
comes 

- \{VW)f + iVW)? = (68) 

hence 



daffi) d^P) =Q (g9) 



A 



B = 



Let us split the evaluation of Eq. ([M]) in two terms A,B (such that the 
equation reduces to AB — 0) by defining and evaluating 

-^^=/?( A /(^y-tanh(/3 v ^))) (70) 

^ = -^=(yR)-(yR>) 2 ). (7i) 

dp A^{m 2 ) \ ' 

Putting together the results AB — we obtain 

/3(y^-tanh(/3yR))) J -^(y(^)-( v ^y) 2 ) = 0. (72) 

This equation acts as a bound and, thought in terms of the expression (|69p . 
has a vague variational taste. As in simple system it does not tell us much 
more than that the product of self-consistency and self-averaging goes to 
zero faster than -/V -1 , in complex system has a key role both in defining the 
locking of the order parameters [5] as in controlling the system at criticality 
|10j . Furthermore in such equation the two key ingredient for the behavior 
of the system, i.e. self-consistency and self-averaging, appear together as a 
whole. 
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4.4 Hamilton-Jacobi formalism: order parameter self- 
averaging and response to field 

This section has been adapted from the work |31j where the method, in the 
framework of spin glasses, were originally developed. 

Next step is investigating the self-averaging of the magnetization itself. 
This can be achieved in several ways also within the interpolating tech- 
niques. For the sake of completeness we want to show a very elegant tech- 
nique based on two interpolating parameters. 



The structure of the Hamilton-Jacobi equation 



Let us consider a generalized partition function depending on two parame- 
ter t, x (that we are going to think about in terms of generalized time and 
space) such that the corresponding free energy can be written as follows 

a N (t,x) = -j-lnZ N (t,x) = l-\n^2e^ l: ^<^ N ' T '' 7l+x?: ^< N ^ (73) 

and let us consider its t and x streaming (with obvious meaning, in the 
averages, of the subscript ( )t,x)'- 

dctwit, x) 1/2 



dt 2 
daM{t 1 x 



m 2 N ) t ,x (74) 
= (m N } t , x (75) 



dx 

Let us also define a potential Vn (t, x) as the variance of the magnetization 
in these extended averages: 

V N (t,x) = - ({m 2 N )t, x - {m N )t <x ) (76) 

and introduce an Hamilton function SN{t,x) as SN(t,x) — —aN{t,x). It 
is now possible to formulate the next 

Proposition 5 In the generalized space of the interpolants The following 
Hamilton-Jacobi equation holds 

dS N (t,x) 1 /dS N (t,x)\2 



dt 



+ 2 C J +M^)=0- (77) 
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The plan now is as follows: Let us try and solve at first the free-field solution 
(V(t, x) = 0), from which the proper solution of the mean field fsing model 
(Eq. will follow and we will argue that limjv^ 00 ((m^ r ) — (tojv) 2 ) = 0. 

The free field solution: self-averaging 

If the ^-dependent potential is zero then the energy is a constant of mo- 
tion such that the Lagrangian C, which is trivially ^ ( j^&t^ j > does not 
depend on t (in this bridge with classical mechanics the interpolating pa- 
rameter t takes the same meaning of time) and the trajectories of motion 
are the straight lines x(t) = xq + (m)t. 

If we denote by a bar the Hamilton function which satisfies the free-field 
problem, such solution S(t, x) can be worked out finding a point in the 
space of solution plus the integral of the Lagrangian over the time 



Anyway, as we already stressed, the Lagrangian, in the free-field problem 
does not depend on time and the integral inside the Eq. (|75|) turns out to 
be a simple product, furthermore, as initial point (to, Xq) in the plane (t, x) 
we choose a generic xo but to = as this choice enable us to neglect the 
two body interaction in the partition function and the problem becomes 
straightforward . 
So we have 



on the trajectories x = xq + (m)t. To enforce now the generalized partition 
function defined in (|73p to be the true one of statistical mechanics, remem- 
bering that S(t,x) = —a(t,x) and so S(t,x) = —a(t,x), we must evaluate 
the solution at t = /3, x = 0. The solution is immediate and is 




(78) 



ds N (t,x) i/ ds N (t,x) \* 

dt 2 V dx ) 




(79) 




(80) 
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which coincides with the solution of the model (Eq. ([53]) ) assuming that 



which is is perfect agreement to our request V(t, x) = 0. 
Response to a field 

We understood that, thank to the global gauge symmetry, we can think at 
the cavity field both as an added spin of the system as well as an external 
perturbation. Once considered the cavity field x ^ . Cj as a perturbation 
it may be interesting asking what the associated observable is for such a 
field. It is immediately to check that the observable is the magnetization. 



d x ^^Y, e ~ tHN(a)+X ^ CT, l*=/3,*=o = (m N ) t=0 , x=o = (m N ) (82) 



While it may still look unnecessary for the Ising model we stress that the 
cavity field naturally puts in evidence the symmetry of the perturbing field 
needed to have a projector (a proper "active" selector in the free energy 
landscape). In fact, it is immediate to think at the perturbing field as a 
magnetic field of strength x/(3 in some proper units. In complex systems 
as spin glasses understanding the right coupling field it is not immediate 
and this property can be of precious help as discussed in [3] . 

5 Parisi-like representation 

As a final section, following the early ideas of Guerra [35], we try and 
introduce a formalism close to the Parisi scheme for spin glasses. This trial 
is of course not necessary for the mean field Ising model, but the existence 
of this possibility acts as a bridge to a better understanding of the Parisi 
theory itself. 




(81) 
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5.1 The order parameter 

Writing equation (|2"6")l via the cavity function (f2"9")l we get 

N + 1 

In Z N+1 <J3— — ) = In Zat(/3) +*(/?)+ In 2, (83) 

which can be iterated N — 1 steps approaching the recursive relation 

N 1 7V-i N 1 , , , , 

— = ]vTi ln2+ S ATTT^ivTT^^TT^fe)- (84) 

Ki<N-l 

Let us take the thermodynamic limit of eq. ([5^|) : It is immediate to check 
that the third term of the r.h.s. goes to zero while in the second term the 
summation converges to a Riemann integral and the first term becomes 
In 2: 



being 



Urn a N+1 (J3) = a(fi) =ln2+ / drh(j3(l - m)) (85) 



1 

to = lim — . (86) 



Let us now introduce an auxiliary function as 

*(m) = ]n(e f (™'% *0) ( 87 ) 
where in the dependence on f(rh,y(rh)) there is the boundary constraint 

/(l,y)=mcoshO%) (88) 

such that 

$(l) = ln(e^ 1 '^ E * CTi) ) =¥(t = 0) (89) 

Let us look now for the condition under which $(m) does not depend on 
to (i.e. d m $ = 0): for the sake of convenience, let us introduce 

TO 



/(m) = /(m, — ^2 a, 



— ' J ( e /) 
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with which we write 

N 

,1m .V 



"' <T> {d rh f) } + ^-Y.{a l d y f) f (90) 



and let us consider the following bounds 

N N \ 

, v Em 9 />/I%Eim s /)/I% 



^Ew)/i < ^£iww)/i < - (i^/i>/ (91) 

i i i 

which allow one to introduce a function x : [0, 1] — > [—1, +1] such that 
1 W 

^£<^/>/=*(m)<iWi>/ ( 92 ) 



Remark 7 TTie existence of the function modulus inside the r.h.s. of Eq. 
i9S\) allows one to take into account just one branch at time with complete 
symmetry between the two branches. This reflects the properties of the 
magnetization in the broken ergodicity phase. 

with the scope of moving the independence condition of $ from rh in the 
choice of /, which must obey the following differential problem: 

5.2 The Parisi-like equation 

dmf(m,y) + x(rh)\d y f(m,y)\ = 
f0-,y) = lncosh(/3y) 
and remember that /(O, 0) = $(0) = $(1) = *(t = 0). 



Remark 8 The above equation immediately reveals a big difference be- 
tween the Ising model and the SK: linearity. In fact the Parisi equation 
for the spin glasses '391 is non linear and shows several bifurcation points, 
while, in the problem W3\) . once chosen a branch, the evolution is unique. 
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To start solving (|93|) let us switch to a p variable such that 

p = - I dm'x(m!) (94) 

J fa 

by which the Parisi-like equation for the Ising model turns out to be solvable 
with the D'Alamber technique. Calling in fact rh — ► p f(rh(p),y) — > 
g(p, y) we get 

d P g(p, y) + d y g{p, y) = 

solved by g(p, y) = lncosh(i(p + y)) -> f(q, y) = lncosh(%± dq'x(q'))), 
where the ± signs are choosen accordingly to the branch of the choosen 
derivative of / with respect to y. 
Solving for the ^5>(t = (3) we get 

*(t = 0) =lncosh(/3 / dfh'x{fh')) (95) 
Comparison of the order parameters 

Let us now equate Eq. ((STj) with Eq. (|95|) : We immediately obtain 

\J (to 2 ) = (rn) = / dmx(m) (96) 
Jo 

by which we argue that the function x{fh) has the meaning of a probability 
density for the order parameter (i.e. the magnetization). Further one 
could go beyond this scheme, but this will not be discussed here, working 
out the equivalent of the broken replica bound to make sharper statements 
concerning the a; (to) following [28) . 

Remark 9 Another possibility is by exploring the replica trick method J39]/ 
assigning a delta-like probability distribution for the interaction matrix Jij 
(i.e. P(Jij) ~ 5(Jij — l)) which factorizes replicas and no ansatz is required 
in this simple case. 
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6 Conclusion 



In this paper we have studied the mean field Ising model with the inter- 
polating techniques. These methods, which have been at the basis of a 
recent breakthrough in spin glass theory turn out to be of great gener- 
ality, property that has been successfully tested investigating this simpler 
model. Several techniques, linked one another by the interpolation method, 
have been shown throughout the paper: key ingredients for the free energy 
thermodynamic limit are the sub-additivity and the bounds in the volume 
size. Another central role is played by the gauge invariance when analyzing 
the expression of the free energy itself: via this symmetry the cavity field 
becomes a perturbing external field (what is called stochastic stability in 
spin glass literature) and viceversa and the synergy between the two ap- 
proaches enables one to work out several properties of the model as the 
critical behavior and the self-averaging relations. The technique with two 
interpolating parameters has also been discussed: a suitable streaming of 
a generalized free energy with respect to these parameters can bring to 
the formulation of an Hamilton- Jacobi equation in the interpolation space 
by which again the solution of the model and the self-averaging can be 
deduced. At the end a formulation of the theory in terms of Parisi rep- 
resentation is tried, with particular emphasis on the meaning of the order 
parameter. 

As a last remark we stress that this work has been written with the aim 
of developing a simpler but dense exercise of statistical mechanics to make 
these techniques ready to be used to the reader not familiar with the field 
of spin-glasses. 
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